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CHAPTER  I 


INTRODUCTION 

Background 

In  this  age  of  high  technology,  the  key  to  effective 
management  is  the  ability  to  obtain  and  use  vast  amounts  of 
information.  The  arrival  of  computers  and  modern  communica¬ 
tion  capabilities  has  resulted  in  quantities  of  data  being 
available  at  a  very  rapid  pace.  In  order  to  properly  use 
this  enhanced  management  capability,  the  user  needs  to  have 
an  information  system  which  meets  his  requirements  at  the 
proper  time.  However,  a  manager  could  be  rapidly  inundated 
with  vast  amounts  of  data,  much  irrelevant,  which  could 
hamper  decision  making  as  much  as  before.  The  key,  then,  is 
to  be  able  to  obtain  the  proper  quantity  and  quality  of  data 
at  the  right  time  resulting  in  information  which  allows  more 
effective  decision  making. 

Having  limited  resources  available  in  today's  Air  Force, 
the  emphasis  is  to  develop  and  field  weapon  systems  which 
meet  support  and  readiness  requ i rements .  To  ensure  these 
weapon  systems  meet  such  requ i rements ,  it  is  necessary  to 
obtain,  store,  analyze  and  evaluate  system  performance  in  a 
timely  manner.  The  Air  Force  accomplishes  this  by  utilizing 
numerous  computers  and  aata  collection  methods. 


The  Maintenance  Data  Collection  (MDC)  system  is  the 
present  management  system  the  Air  Force  uses  to  monitor 
equipment/system  performance.  Basically,  the  MDC  system 
records  and  reports  the  how,  what,  and  when  of  the  main¬ 
tenance  work  performed  on  all  aircraft,  missiles,  ground 
communications,  electronics,  meteorological  equipment,  and 
related  end  items.  Maintenance  action  data  is  documented 
manually,  collected  centrally,  keypunched  and  processed  for 
computer  storage  and  manipulation  (2:4).  Some  form  of 
optional  maintenance  action  reporting  has  been  ongoing  since 
1955.  After  1958,  mandatory  reporting  of  the  MDC  system  was 
required  by  AFM  66-1  (2:6).  As  a  result  of  this  mandatory 
reporting,  the  data  collection  effort  was  further  changed  in 
1965  to  the  present  MDC  system. 

Since  the  decision  for  mandatory  reporting,  the  actual 
collection  and  reporting  became  a  herculean  effort.  This 
led  tn  a  drop  in  reporting  factors  such  as  work  force  employ¬ 
ment.  This  reduction  in  reporting  procedures  left  the  MDC 
system  as  it  exists  today.  Although  the  Air  Force  has  used 
the  current  MDC  system  since  1965,  it  has  received  constant 
criticism  over  the  years.  An  increased  emphasis  on  reporting 
the  data  rather  than  how  the  data  could  be  used  has  been  an 
area  of  criticism  since  the  1958  mandatory  reporting  went 
into  affect.  Other  criticisms  and  problems  of  the  MDC  sys¬ 
tem  are  shown  in  Table  1. 


The  basic  concern  over  the  current  MDC  system,  as  for 

any  data  base  system,  is  the  users  are  not  receiving  the 

information  they  need  to  support  managerial  decision  making. 

In  regard  to  MDC,  it  has  been  stated:  .  .  .  the 
most  telling  criticis  is  that  the  MDC  system 
doesn't  really  provide  the  manager  information 
at  all,  it  just  provides  reformatted  data  (2:12-13). 

Actually,  the  MDC  system  collects  maintenance  data  from  all 
Air  Force  bases  into  a  computer  system  which  aggregates  that 
data  and  then  produces  fixed  paper  formatted  reports.  From 
these  reports  the  data  can  be  analyzed  only  by  manual 
extraction,  preparation  and  presentation  to  managers  for 
facilitating  any  decision  process.  By  the  time  these  pre¬ 
sentations  are  available  to  management,  the  information  can 
be  several  weeks  or  months  old. 

As  a  result  of  the  criticisms  and  problems  relating  to 
the  overall  usefulness  and  effectiveness  of  the  MDC  system 
and  the  reports  generated  from  it,  several  users  of  the  MDC 
system  data  have  developed  additional  computer  resources  to 
assist  them  in  their  informational  requirements.  Presently, 
two  system  program  offices  (SPO)  in  Aeronautical  Systems 
Division  at  Wri ght-Patterson  Air  Force  Base  have  utilized 
additional  computer  resources. 
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The  basic  concern  over  the  current  MDC  system,  as  for 

any  data  base  system,  is  the  users  are  not  receiving  the 

information  they  need  to  support  managerial  decision  making. 

In  regard  to  MDC,  it  has  been  stated:  .  .  .  the 
most  telling  criticism  is  that  the  MDC  system 
doesn't  really  provide  the  manager  information 
at  all,  it  just  provides  reformatted  data  (2:12-13). 

Actually,  the  MDC  system  collects  maintenance  data  from  all 
Air  Force  bases  into  a  computer  system  which  aggregates  that 
data  and  then  produces  fixed  paper  formatted  reports.  From 
these  reports  the  data  can  be  analyzed  only  by  manual 
extraction,  preparation  and  presentation  to  managers  for 
facilitating  any  decision  process.  By  the  time  these  pre¬ 
sentations  are  available  to  management,  the  information  can 
be  several  weeks  or  months  old. 

As  a  result  of  the  criticisms  and  problems  relating  to 
the  overall  usefulness  and  effectiveness  of  the  MDC  system 
and  the  reports  generated  from  it,  several  users  of  the  MDC 
system  data  have  developed  additional  computer  resources  to 
assist  them  in  their  informational  requirements.  Presently, 
two  system  program  offices  (SPO)  in  Aeronautical  Systems 
Division  at  Wright-Patterson  Air  Force  Base  have  utilized 
additional  computer  resources. 


Difference  Between  Data  and  Information 


To  provide  a  common  frame  of  reference,  the  following 
terms  are  defined  as  they  are  used  in  this  thesis: 

Data .  A  representation  of  facts,  concepts  or  instruc¬ 
tions  in  a  formalized  manner  suitable  for  communication, 
interpretation  or  processing  by  humans  or  machines  (5:571). 

Informati on .  (1)  data  that  has  been  transformed  into  a 

meaningful  and  useful  form  for  specific  human  beings;  (2) 
the  meaning  that  a  human  assigns  to  data  by  means  of  the 
known  conventions  used  in  their  representation  (5:575). 


Statement  of  the  Problem 


The  current  emphasis  in  the  defense  establishment  are 
support  and  readiness.  With  increased  use  of  highly  tech¬ 
nological  and  expensive  weapon  systems,  the  emphasis  is  on 
the  support  and  readiness  of  these  systems.  As  stated  in  a 
DOD  joint  agreement  in  June  1983  (13): 

Improvements  in  support  and  readiness  are  major 
DOD  objectives  in  both  the  weapon  system  and  sup¬ 
port  technology  areas.  Technical  innovation  is 
essential  to  improve  the  readiness  of  our  systems. 

We  agree  to  increase  the  emphasis  on  technology 
areas  which  can  increase  mission  reliability, 
reduce  dependence  on  support  equipment,  spares 
and  repair  facilities,  and  reduce  the  need  for 
highly  skilled  personnel. 

The  key  to  meet  the  support  and  readiness  issue  is  to 
have  reliability  and  maintainability  (R&M)  in  the  Air  Force 
weapon  systems.  Through  reliability  a  weapon  system  has  a 


high  probability  of  completing  its  mission  without  failing. 
However,  when  a  system  does  fail  it  is  important  to  have 
the  capability  to  quickly  repair  and  maintain  it.  So  sup¬ 
port  and  readiness  objectives  are  dependent  upon  a  weapon 
system's  reliability  and  maintainability  characteristics. 

The  MDC  system  is  one  tool  which  the  Air  Force  uses  to  moni¬ 
tor  weapon  system  R&M.  Headquarters  Air  Force  Logistics 
Command  (AFLC)  has  the  respon s i bi 1 i ty  (16:3): 

In  coordination  with  the  command  having  PMR 
(Program  Management  Responsibility)  and  using 
commands,  determines  the  data  required  to 
realistically  measure  reliability,  maintain¬ 
ability  safety  and  logistics  support  costs  of 
operational  systems. 

AFLC  establishes  a  program  including  management  controls 
to  ascertain  that  each  system  fielded  by  the  Air  Force 
achieves  its  R&M  requirements.  Included  in  this  program  is 
the  MDC  system.  Further  responsibilities  of  AFLC  regarding 
reliability  and  maintainability  are: 

1.  Establish  and  maintain  a  management  information 
system  keyed  to  work  unit  codes  and  based  on  operations  and 
maintenance  data  to  reflect  the  degree  of  achieved  R&M  for 
operational  systems  in  operational  R&M  terms. 

2.  Establish  and  maintain  a  R&M  performance  feedback 
system  to  support  the  effective  design,  support,  and  pro¬ 
duction  of  new  systems. 

3.  Furnish  appropriate  R&M  management  and  data  pro¬ 
ducts  for  operational  systems  in  operational  R&M  terms  to 
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the  implementing  command,  .  .  and  the  operating  command 
(14:6) . 

The  management  information  system  which  AFLC  has  today 
consists  of  two  data  areas:  maintenance  and  operations. 

The  system  to  provide  the  maintenance  data  portion  is 
obtained  from  AFR  66-267,  Maintenance  Data  Collection  (MDC) 
System  (15).  The  operational  data  is  obtained  from  AFR  65- 
110,  Operational  Status  and  Utilization  Data  G033  B  Reports 
(12).  Both  the  maintenance  and  operational  data  are  sub¬ 
mitted  monthly  and  inputted  into  AFLC  computers  which  then 
generate  the  fixed  formatted  reports.  The  reports  dealing 
principally  with  equipment  or  system  operational  effective¬ 
ness  are  the  AFLC  D056  series  reports  (11).  Figure  1  depicts 
how  the  different  sources  of  data  come  together  and  result 
in  the  0056  reports  which  then  are  used  by  different  agencies 

Problems  exist  with  these  D056  reports  for  agencies  who 
attempt  to  use  them  for  reliability  and  maintainability 
evaluations  or  studies.  Some  of  the  major  problems  are: 

1.  Timeliness.  The  time  a  weapon  system  experiences 
R&M  problems  to  the  time  the  negative  trend  shows  up  in  a 
report  could  easily  vary  three  to  six  months  (3:6). 

2.  Data  reports  are  fixed  formatted.  Most  data  is 
aggregated  to  such  a  point  that  it  is  difficult  to  determine 
to  which  base  or  location  the  data  refers  or  if  all  loca¬ 
tions  are  experiencing  R&M  difficulties. 


3.  Reports  do  not  contain  the  level  of  detail  neces¬ 


sary  to  determine  what  specific  equipment  or  system  is 
causing  R&M  problems  (6). 

4.  Management  information  system  does  not  routinely 
perform  automated  analysis  or  trending.  Therefore,  analysis 
desired  by  the  R&M  engineer  must  be  performed  manually. 

Since  this  is  tedious  and  intense  work,  manpower  cuts  in 
many  organizations  has  decidely  limited  analysis  of  the  data 
(10:7;  1;  3;  6). 

5.  Current  data  systems  do  not  produce  information  in 
management  usable  form.  Again,  the  data  must  be  manually 
prepared  for  presentation  to  the  management  level  to 
facilitate  the  decision  process  (10:7). 

The  present  maintenance  and  operational  data  reports 
fail  to  meet  two  users'  needs  in  regard  to  R&M  information. 
They  have  acquired  access  to  additional  computer  resources 
to  improve  their  R&M  analysis.  The  two  organizations  are 
the  F-16  System  Program  Office  (SPO),  and  the  Strategic 
Systems  SPO,  both  of  the  Aeronautical  Systems  Division  (AFSC 
organization)  at  Wri ght-Patterson  Air  Force  3ase.  This 
thesis  evaluates  and  compares  the  R&M  products  produced  by 
these  two  additional  data  base  systems.  These  additional 
computer  data  based  systems  are  the  MARCON  Computerized 
Data  System  for  the  F-16  SPO  (MARCON  System),  and  The 
Analytic  Sciences  Corporation  (TASC)  Field  Data  Tracking 
System  (FDTS)  for  the  Strategic  Systems  SPO  (TASC  System). 
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This  study  was  concerned  with  the  two  computer  data 
base  systems  (i.e.,  MARCON  and  TASC  systems)  which  two  ASD 
program  offices  are  using  to  support  their  R&M  analysis.  No 
attempt  was  made  to  determine  if  the  AFLC  report  system  was, 
in  fact,  inadequate  in  providing  R&M  information  or  any 
information.  It  was  assumed  the  program  offices  had  adequate 
requi remen ts  for  obtaining  additional  informational  support. 

Also,  no  attempt  was  made  to  determine  if  any  other 
users  of  the  AFLC  reports  were  experiencing  any  problems 
with  content,  format  or  timeliness  of  the  AFLC  reports 
regarding  R&M  information. 

The  goal  of  this  study  was  to  determine  if  the  new  data 
base  systems  are  providing  a  more  timely  and  usable  informa¬ 
tional  product  which  can  aid  the  manager  decision  process. 

Objectives  of  the  Research 

The  objective  of  this  thesis  is  to  analyze  two  new 
reliability  and  maintainability  (R&M)  data  base  systems 
being  used  by  two  ASD  program  offices  to  determine  if  they 
provide  an  improved  information  system  over  the  present  AFLC 
generated  product  performance  reports.  With  an  improved 
source  of  R&M  information,  the  Air  Force  would  be  better 


able  to  meet  its  weapon  systems  support  and  readiness  goals. 
A  secondary  objective  was  to  compare  the  two  systems  in 


regard  to  system  compatibility.  In  the  last  five  years, 
with  the  rapid  advances  in  computer  technology,  there  exists 
the  problem  of  the  Air  Force's  increased  use  of  computer 
systems  that  lack  commonalty.  In  regard  to  R&M  data  bases, 
it  would  be  beneficial  to  have  the  capability  to  share  com¬ 
mon  R&M  information  between  different  weapon  systems. 

Research  Questions 

Research  questions  associated  with  the  research  ques¬ 
tions  are: 

1.  What  are  the  relative  improved  performance  character 
istics  of  the  two  new  R&M  data  bases  used  by  ASD? 

* 

I 

2.  What  are  the  common  characteristics  of  the  two  new 


systems? 


CHAPTER  II 


LITERATURE  REVIEW 
Introduction 

Available  literature  pertinent  to  this  thesis  topic 
centered  primarily  on  the  AFLC  management  information  system. 
There  were  few  documents  on  the  two  new  data  base  systems. 
This  is  understandable  since  the  AFLC  system  has  been  ongoing 
since  the  late  sixties,  while  the  MARCON  and  TASC  systems 
have  only  been  operational  in  the  Air  Force  since  1980-81. 

Two  research  studies  and  a  technical  report  were 
generated  on  the  AFLC  system  by  the  Air  Force  Institute  of 
Technology,  while  the  literature  covering  the  newer  data 
systems  consisted  mainly  of  contractor  reports  and  Air 
Force  briefings  concerning  systems  capabilities  and  initial 
operational  goals. 


Previous  Studies 

In  August  1967,  Major  Harold  G.  Hartley  and  Captain 
Richard  V.  Jamieson  (4)  wrote  a  thesis  on  the  use  of  the 
Maintenance  Data  Collection  System  and  its  generated  reports 
at  the  major  command  level.  Previous  studies  had  been  con¬ 
ducted  at  the  base  level.  They  did  a  complete  review  of  the 
different  reports  which  were  created  by  the  MDC  system  at 


that  time.  They  then  surveyed  the  various  major  commands  to 
determine  how  effectively  the  MDC  system  was  being  used. 

The  result  of  their  research  showed  the  MDC  system  was 
not  being  effectively  utilized  by  the  major  command  head¬ 
quarters  (4:71).  Their  study  even  indicated  the  commands 
were  using  other  sources  of  information  rather  than  MDC 
information.  They  stated, 

Command  level  personnel  utilized  reports  and 
communications  media  that  were  not  integral  to 
the  MDC  system  as  the  primary  means  of  satisfying 
their  management  information  requirements  (4:70). 

Another  finding  in  their  study  was  that  command  special 
report  requirements  most  successfully  fulfilled  the  MDC 
requirements  of  using  commands  (4:71).  Basically,  the 
command  reports  provided  the  timeliness  lacking  in  the  MDC 
formal  reports.  So,  back  in  1967,  the  timeliness  issue  of 
the  MDC  reports  was  as  much  a  problem  as  it  was  in  the  1980- 
81  period  which  led  to  the  MARCON  and  TASC  systems  inception. 

In  February  1971,  Captains  Irving  L.  Hoffman  and  Robert 
L.  Warddrip  (8)  completed  a  student  thesis  proposing  criteria 
and  data  for  a  reliability  and  maintainability  information 
system.  Basically,  they  tried  to  arrive  at  standardized 
terminology  to  be  used  by  all  organizations  dealing  with 
reliability  and  maintainability  issues,  after  which  they 
developed  the  criteria  and  data  elements.  From  their  study, 
they  concluded  that  a  reliability  and  maintainability  infor¬ 
mation  system  should: 


1.  provide  information  on  what  management  needs  to  know 
about  reliability  and  maintainability, 

2.  provide  a  system  for  collection  of  pertinent  data, 

and 

3.  present  the  information  derived  from  the  data  in 
usable  form  to  support  the  making  of  decisions  (8:102). 

They  concluded  that  R&M  information  on  Air  Force 
operational  systems  was  impaired  by  a  pervading  lack  of 
confidence  in  the  information's  quality  (8:105).  They  even 
stated : 

Perhaps  we  should  accept  our  operational 
reliability  and  maintainability  information 
as  approximate  and  use  it  as  an  "indicator" 
only  (8:102). 

The  results  of  their  research  indicated  a  lack  of 
confidence  in  the  quality  of  data  as  provided  by  the  MDC 
system  at  that  time. 

Other  Sources 

In  February  1978,  Majors  Richard  V.  Badalamente  and 
Thomas  D.  Clark  wrote  a  technical  report  on  an  analysis  they 
conducted  on  the  MDC  system  (2).  They  provided  a  historical 
review  of  the  problems  attributed  to  the  MDC  system  since  its 
inception  in  1955.  They  categorized  these  problems  (Table 
1)  as  dealing  with  accuracy,  reliability,  accessibility, 
usability  and  efficiency  (2:11).  They  stated  that  reporting 
data  rather  than  the  use  of  information  in  the  decision 


process  had  received  the  main  emphasis  in  the  MDC  system. 

One  of  the  conclusions  of  their  report  was  that  to  have 
an  effective  MDC  system  you  needed  to  ensure  the  data  was 
transformed  into  information  and  effectively  used  in  the 
decisional  structure. 

A  January  1983  report  from  The  Analytic  Sciences 
Corporation  ( T AS C )  reported  on  the  Field  Data  Tracking 
System  (FDTS)  which  TASC  developed  for  the  Strategic  Systems 
System  Program  Office  (SSSPO)  (9).  The  report  discussed  the 
utility  of  the  present  FDTS  and  how  the  system  might  expand 
in  the  future.  Basically,  this  data  system  collected  addi¬ 
tional  maintenance  data  elements  in  regard  to  the  MDC  system 
and  displayed  the  information  in  various  formats  rather  than 
just  a  fixed  format. 

Overall,  this  TASC  document  reported  on  one  of  the  new 
data  base  systems  being  used  to  provide  additional  R&M 
information  to  a  program  office. 

Summary 

This  literature  review  has  presented  the  most  pertinent 
documents  dealing  in  the  same  general  area  as  this  research. 
Most  dealt  with  the  problem  areas  of  the  current  MDC  system. 
However,  these  documents  show  the  reasoning  behind  the 
development  of  additional  computer  resources  to  support  R&M 
data  requ i rements . 


CHAPTER  III 


METHODOLOGY 

Overview  of  Research 

The  main  procedure  used  to  answer  the  research  questions 
regarding  the  MARCON  and  TASC  data  base  systems  was  to  set  up 
a  criteria  list  by  which  to  evaluate  the  information  provided 
by  the  two  new  systems.  With  this  criteria,  both  systems  can 
be  compared  on  an  equal  basis  in  order  to  determine  whether 
the  systems  do  provide  additional  information  to  aid  in  R&M 
analysis. 


Informational  Criteria 

The  first  set  of  criteria  is  very  general  and  can  be 
used  to  assess  various  elements  of  information.  The 
following  list  of  criteria  was  obtained  from  the  Hoffman  and 
Warddrip  thesis  (8)  concerning  the  criteria  and  data  neces¬ 
sary  for  an  R&M  information  system. 

1.  Is  the  information  accurate  enough? 

2.  Is  there  enough  information  available  to  make 
deci si ons? 

3.  Is  the  information  relevant  to  the  decisions  which 
must  be  made? 

4.  Is  the  information  capable  of  being  understood  by 
those  who  must  use  it? 

5.  Is  the  information  available  when  it  is  needed? 


6.  Is  compatible  information  available  from  a  secondary 
source? 

7.  Is  the  overall  value  of  the  information  adequate  for 
decision-making  purposes? 

Since  the  criteria  listed  above  is  very  general,  a 
second  list  was  developed  based  on  the  numerous  problem  areas 
associated  with  the  MDC  system.  These  problems  were  covered 
in  Table  1  and  other  documents  discussed  in  the  literature 
review  chapter.  The  additional  informational  system  criteria 
are: 

8.  Cost 

-  initial  start-up  cost 

-  yearly  continuation  costs 

9.  Type  of  reports 

-  type  of  format 

-  monthly,  3-month  average,  cumulative,  etc. 

10.  sources  of  basic  data 

-  Are  there  redundant  sources  to  eliminate 
i nconsi stenci es? 

11.  storage  capability 

-  How  many  years  of  data  can  be  stored? 

12.  tracking  capability 

-  What  level  of  detail  can  be  stored? 

13.  Does  information  match  user's  needs? 

-  Are  outputs  being  used? 

14.  benefits 

-  Have  decisions  improved? 

-  Has  time  been  saved? 

15.  use  of  the  data  base 

-  Does  it  cover  the  whole  weapon  system  or  just 
a  specific  area? 


Nature  and  Sources  of  Data 


It  became  quite  difficult  to  collect  sufficient  data  for 
the  assessment  of  the  criteria  lists.  Since  both  the  MARCON 
and  TASC  systems  are  fairly  new  (beginning  1980-81),  there 
was  very  little  written  documentation  regarding  informational 
output  capabilities.  Only  the  TASC  system  had  a  formal 
report  and  it  was  prepared  by  the  source  contractor  and  not 
the  Air  Force.  Therefore,  the  majority  of  the  data  collec¬ 
tion  was  accomplished  through  interviews  with  personnel  in 
the  program  offices  who  deal  with  R&M  matters.  Originally, 
these  interviews  were  to  be  conducted  using  a  checklist  of 
questions.  This  checklist  was  based  on  a  similar  checklist 
used  by  Hoffman  and  Warddrip  in  their  research  (8).  However, 
once  the  actual  interviews  were  started  the  checklist  proved 
to  be  inadequate  to  the  uniqueness  of  each  data-based 
system.  Each  interview  was  based  on  questions  generated 
from  an  earlier  research  and  other  interviews.  Basically, 
it  was  a  stepping  stone  type  process  leading  to  additional 
data  and  knowledge  at  each  of  the  data  systems. 

For  the  MARCON  system,  individuals  interviewed  were  Mr 
Wally  Detert,  ASD/ENSSR,  in  charge  of  the  engineering  office 
dealing  with  R&M  (3),  and  Mr  Jeff  Anderson,  engineer  in  the 
F - 1 6  SPO  (1).  The  source  for  the  majority  of  the  data 
collected  on  the  TASC  system  was  Mr  Phil  Hermes,  ASD/YYEE, 

R&M  engineer  in  the  Strategic  Systems  SPO  (6).  Mr  Hermes 


was  instrumental  in  obtaining  the  TASC  system  for  the  SPO 
and  is  the  resident  expert  on  all  facets  of  the  TASC  system. 


Numerical  values  were  assigned  to  the  two  data  based 
systems  depending  on  how  each  met  the  criteria.  If  both 
systems  met  a  particular  criteria  each  were  given  a  one 
rating.  A  rating  of  zero  was  given  if  a  system  did  not  meet 
the  criteria.  However,  if  one  system  is  more  superior  than 
the  other,  it  will  be  given  an  additional  value  of  one  for  a 
total  rating  of  two. 

The  15  criteria  areas  do  not  have  the  same  importance 
regarding  R&M  factors.  Therefore,  the  15  areas  were 
separated  into  three  weighted  categories  based  on  their 
importance  with  each  category  assigned  a  different  point 
value.  Then  based  on  the  numerized  total,  a  conclusion  was 
made  on  which  data  base  system  best  met  the  overall  infor¬ 
mational  objective.  The  categories,  point  values,  and 
criteria  breakout  is  as  follows: 


Category 

Point  Values 

Criteria  # 

1. 

Most  Important 

3  points 

3,5,7,9,12,14,15 

2. 

Average  Importance 

2  points 

1,4,8,10,11,13 

3. 

Minor  Importanct 

1  point 

2,6 

CHAPTER  IV 


RESULTS 

Introduction 

The  main  objective  of  this  research  effort  was  to 
analyze  two  new  reliability  and  maintainability  data  base 
systems  to  determine  if  they  provide  improved  information 
over  the  present  AFLC  Maintenance  Data  Collection  reports. 
Achieving  this  objective  was  accomplished  by  using  a  set  of 
criteria  to  subjectively  compare  character! sti cs  of  each 
data  base. 

A  second  objective  was  to  observe  how  compatible  the  two 
system's  R&M  information  might  be.  This  objective  was 
accomplished  utilizing  the  same  criteria  analysis  as  men¬ 
tioned  above. 

An  important  point  concerning  the  source  of  basic  main¬ 
tenance  and  operational  data  for  the  two  data  bases  needs  to 
be  made  at  this  time.  Basically,  the  MARCON  and  TASC  systems 
used  the  same  maintenance  and  operational  data  as  the  present 
AFLC  MDC  system.  The  MARCON  system  does  use  the  exact  same 
D056  data  tapes,  based  on  AFTO  349  maintenance  reports  that 
the  MDC  system  uses.  However,  the  MARCON  system  converts 
the  data  into  timely  and  usable  information,  which  will  be 
covered  in  the  following  analysis  section.  While  the  TASC 


system  used  the  same  data  as  the  MDC  system,  it  obtains  it 
with  base  computer  tapes  rather  than  the  D056  data  tapes. 
However,  the  TASC  system  goes  further  than  the  MDC  system 
and  collects  all  the  data  available  from  the  AFTO  349  reports 
as  well  as  additional  data  from  forms  AFTO  95  and  SAC  126 
(Figure  2).  This  also  will  be  covered  in  the  following 
analysis,  while  examples  of  these  reports  are  found  in 
Appendix  A. 

The  point  made  is  that  the  inputs  for  the  MARCON  system 
are  the  same  as  those  for  the  MDC  system,  while  those  for  the 
TASC  system  are  much  more  detailed  than  those  for  the  MARCON 
and  MDC  systems. 


Analysis 

The  analysis  was  conducted  along  the  criteria  lines  set 
up  in  the  previous  chapter  for  the  MARCON  and  TASC  systems 
(first,  the  general,  then  the  additional  criteria).  The 
sources  for  the  information  were  the  respective  program 
offices:  for  MARCON,  the  F-16  SPO,  and  for  TASC,  the 
Strategic  Systems  SPO,  unless  otherwise  indicated. 

General  Criteria. 

1.  Accuracy.  The  MARCON  system's  accuracy  is  com¬ 
parable  to  the  MDC's,  as  they  ooth  use  the  same  inputs  as 


mentioned  earlier,  while  TASC  is  more  accurate  since  it  uses 
additional  data  with  some  of  the  data  being  redundant,  there¬ 
by  helping  to  eliminate  inconsistencies  (9:2-6). 
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Figure  2.  TASC  System  Flow  Chart  (6) 


2.  Quanti ty .  MARCON  and  TASC  systems  were  the 
same  in  this  area.  Both  provided  almost  unlimited  ways  to 


utilize  the  data  for  decision-making  support. 

3.  Relevance.  The  information  showed  itself  to 
be  relevant  in  both  the  MARCON  and  TASC  systems  due  to  their 
timeliness.  Each  system  has  the  capability  to  generate 
“what  if"  exercises  at  will,  once  the  input  data  has  been 
loaded.  Neither  system  is  restricted  by  fixed  formats  such 
as  the  MDC  reports. 

4.  Simp! icity.  The  MARCON  or  TASC  systems  can 
produce  several  types  of  graphs  which  can  represent  trends  or 
other  types  of  information.  The  graphs  convey  information 
more  effectively  than  pages  full  of  figures. 

5.  Timeliness.  The  time  required  to  input  the 
basic  data  into  the  two  newer  systems  is  roughly  the  same 
with  the  MDC  (i.e.,  30-60  days  after  the  event).  However, 
once  MARCON  and  TASC  systems  are  inputted  with  the  latest 
data,  any  type  of  informational  reporting  is  available, 
whereas  the  MDC  can  only  supply  pre-requested  information. 
Both  the  MARCON  and  TASC  systems  have  real-time  retrieva- 
bility  in  obtaining  information  (See  Figure  2  for  TASC  flow 
chart).  Any  special  request  for  data  in  the  MDC  system 
requires  additional  time  for  extraction  of  the  information. 

6.  Compatabi 1 i ty .  Only  the  TASC  system  has  a 
redundant  or  secondary  source.  As  shown  in  Figure  3,  the 
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Figure  3.  TASC  Data  Process  (6) 


TASC  system  uses  the  MDC  tapes  to  resolve  any  anomalies  which 
may  occur  between  the  TASC  base  maintenance  tapes  and  MDC 
D056  tapes. 


7.  Qual i ty .  The  MARCON  and  TASC  systems  show  the 
same  quality  of  performance  as  the  MDC  system  except  for  the 
small  increase  in  accuracy  for  the  TASC  system  resulting  from 
redundant  data  inputting.  The  basic  reason  for  the  same 
quality  value  throughout  is  that  all  systems  are  using  the 
same  raw  data.  Until  the  collecting  and  recording  of  main¬ 
tenance  and  operational  data  improves  at  the  field  level,  all 
systems  will  have  the  same  problem:  i.e.,  output  data  can 

be  no  more  accurate  than  the  input  data. 

Additional  Informational  Criteria. 

8.  Cost .  Cost  data  regarding  MARCON  was  unavail¬ 
able,  The  development  contract  for  TASC  was  six  million 
dollars  and  a  twelve-month  operational  contract  was  worth 
$900,000  (6). 

9.  Type  of  Reports.  Both  the  MARCON  and  TASC 
systems  can  provide  various  report  types,  i.e.,  monthly, 
three-month  moving  average,  cumulative,  etc.  (See  Appendices 
B  and  C  for  examples.)  Since  each  system  is  real-time,  it 
is  up  to  the  user  to  decide  his  requirement  needs.  The  TASC 
system  can  provide  information  in  either  tabular,  graphic  or 
narrative  form.  The  flexibility  in  the  TASC  system  outputs 
provides  useful  support  spanning  three  areas:  (a)  overview 


and  trend  information  (Table  2);  (b)  specific  equipment  or 
action  information  (Table  3);  and  (c)  detailed  information 
(Table  4 ) . 

10.  Sources  of  basic  data.  As  discussed  earlier, 
the  TASC  system  is  the  only  one  which  uses  redundant  sources 
base  computer  tapes  along  with  MDC  basic  tapes  (Figure  3). 

11.  Storage  capabi  1  i  t,y.  The  MARCON  system  can 
retain  all  data  on  the  F - 1 6  system  back  to  its  operational 
beginning  in  1979.  The  TASC  system  has  on-line  data  going 
back  to  January  1981.  However,  the  MARCON  system  includes 
the  majority  of  the  systems  on  the  F-16,  i.e.,  the  majority 
of  Work  Unit  Codes  (WUC)  in  the  data  base  (2800  WUC)  (3), 
whereas  the  TASC  system  for  the  Strategic  Systems  SPO  only 
has  data  on  two  areas:  Air  Launch  Cruise  Missile  and 
Offensive  Avionics  System.  Other  aircraft  equi pment/systems 
data  has  not  been  inputted  in  the  TASC  system. 

12.  Tracking  capability.  MARCON  and  TASC  systems 
both  have  the  capability  to  monitor  and  track  maintenance 
data  by  base,  type  of  aircraft.  Work  Unit  Codes,  and  to  some 
degree,  line  replaceable  units/shop  replaceable  units. 
However,  the  TASC  can  track  individual  aircraft  tail  numbers 
more  easily  than  MARCON. 

13.  Information  and  users'  needs.  MARCON  system 
has  been  beneficial  to  all  the  offices  in  the  F-16  SPO  and 
especially  to  the  R&M  engineers.  In  the  early  part  of  1983, 


Table 


the  program  office  thought  they  had  an  R&M  problem  with  the 
F-16s  at  MacDill  AFB  and  Hill  AFB .  The  MARCON  data  system 
reports  enabled  the  SPO  to  reduce  the  time  in  determining 
the  actual  problem.  It  was  found  that  the  problem  was  not 
with  any  system  R&M  but  rather  how  maintenance  actions  were 
reported.  The  TASC  reports  are  used  to  indicate  when  problems 
in  R&M  start  to  occur.  Based  on  these  reports,  the  SPO  can 
use  the  information  to  prioritize  problems.  Before  the  TASC 
system,  problems  were  solved  on  a  "first-come,  first  served" 
basis  which  often  led  to  poor  utilization  of  funds. 

14.  Benefits.  In  both  systems,  the  greatest  bene¬ 
fit  has  been  in  the  area  of  timeliness.  The  systems  save 
many  manhours  in  collecting,  analyzing,  and  preparing  data 

to  solve  problems  which  may  arise  in  the  R&M  area.  Personnel 
can  now  spend  more  time  analyzing  and  evaluating  information 
rather  than  in  collecting  the  data. 

15.  Use  of  the  data  base.  As  discussed  earlier, 
the  MARCON  system  covers  the  majority  of  equipment  on  the 
F-16  system,  whereas  the  TASC  system  has  been  very  specific 
in  that  it  only  has  two  subsystems  in  its  data  base:  the 
Air  Launch  Cruise  Missile  and  the  Offensive  Avionics  System. 

Numerical  Analysis 

Based  upon  the  above  analysis  of  each  system  regarding 
the  15  criteria  areas,  a  subjective  rating  was  assigned  to 
eacn  system.  From  the  ratings  and  point  values  the  total 


amount  of  points  was  determined  for  each  data  base  system. 

For  the  cost  criteria  (Number  8),  both  systems  were 
assigned  a  rating  of  zero  since  cost  figures  for  MARCON  and 
MDC  systems  were  unavailable.  The  problem  with  obtaining 
the  cost  figures  for  the  MDC  system  is  breaking  out  the  costs 
specifically  incurred  by  the  F - 1 6  and  Offensive  Avionics/Air 
Launch  Cruise  Missile  Systems. 

The  results  of  the  subjective  numerical  analysis  are 
shown  in  the  matrix  below.  Even  though  both  systems  accumu¬ 
lated  36  points  this  does  not  necessarily  mean  both  systems 
are  totally  equal.  A  basic  difference  will  be  discussed  in 
the  next  chapter. 


CHAPTER  V 


SUMMARY,  CONCLUSIONS  AND  RECOMMENDATIONS 

S  uinma  ry 

This  study  was  accomplished  by  addressing  two  research 
questions: 

1.  What  are  the  relative  improved  performance  character 
istics  of  the  two  new  Reliability  and  Maintainability  data 
bases  (MARCON  and  TASC  systems)  used  by  Aeronautical  Systems 
Division  ( F - 1 6  and  Strategic  Systems  S P 0 s ) ? 

2.  What  are  the  common  characteristics  of  the  two  new 
systems? 

Research  Questions.  In  order  to  answer  both  these  ques¬ 
tions,  it  was  appropriate  to  set  up  common  informational 
criteria,  against  which  both  systems  were  evaluated.  The 
criteria  were  comprised  of  a  general  category,  obtained  from 
a  previous  research  thesis  which  dealt  with  R&M  informational 
systems,  and  a  specific  set  of  criteria  which  was  closely 
associated  with  problem  areas  experienced  by  the  current 
Maintenance  Data  Collection  System.  Once  the  criteria  were 
established,  a  numerical  evaluation  of  the  data  systems  was 
conducted . 

As  a  result  of  the  evaluation  and  answering  the  researcn 


questions,  the  objectives  of  this  research  could  be  assessed 
These  objectives  were: 

1.  Main  Objective:  Do  the  new  systems  provide  improved 
R&M  information  over  the  present  MDC  reports? 

2.  Secondary  Objective:  Is  the  R&M  information  of  each 
system  compatible? 

Cone! u  si  on s 

Ob j ect i ve  1 .  Based  on  the  analysis  of  the  data  base 
systems,  it  can  be  concluded  that  both  the  MARCON  and  TASC 
data  base  systems  do  provide  improved  R&M  information.  The 
key  area  of  improvement  was  in  timeliness.  Each  of  the 
systems  could  assess  their  data  bases  in  a  real-time  matter 
and  provide  numerous  types  of  formatted  documents.  By 
reducing  the  time  requirements,  manpower  and  funds  could  be 
saved.  But  the  greatest  benefit  was  that  now  managers  would 
have  access  to  timely  information  to  aid  them  in  their 
decision-making  processes.  Therefore,  overall  system 
reliability  and  maintainability  should  improve,  resulting  in 
weapon  systems  which  meet  the  supportabi 1 i ty  and  readiness 
requi rements . 

Objective  2.  The  second  objective  dealt  with  the  com¬ 
patibility  of  the  two  R&M  data  bases.  This  study  showed  no 
evidence  in  which  the  two  systems  could  share  basic  data 
from  system  to  system.  However,  based  on  the  types  and  for¬ 
mats  of  each  systems  output,  it  would  appear  that  a  manual 


analysis  and  comparison  could  easily  be  accomplished 

Final  Conclusion.  As  shown  in  objective  one  above  both 
systems  do  provide  improved  R&M  information  compared  to  tne 
MDC  data  system.  Also  Dased  on  the  numerical  analysis 
matrix,  both  systems  equaled  36  points.  The  conclusion 
drawn  from  these  findings  could  be  that  both  systems  are 
totally  equal  and  one  is  not  better  than  the  other.  However, 
that  is  not  the  fact.  Each  system  has  superiority  in  the 
particular  area  for  which  it  was  developed.  MARCON  is  a 
general  system  and  provides  maintenance  data  on  the  whole 
F-16  system.  Whereas  the  TASC  system  was  used  specifically 
for  two  components  of  an  overall  weapon  system.  For  overall 
weapon  system  R&M,  MARCON  is  superior  where  TASC  is  superior 
in  regards  to  the  total  R&M  picture  for  a  particular  compo¬ 
nent. 

The  basic  finding  of  this  research  is  that  both  data 
base  systems  do  provide  their  users  with  timely  R&M  data. 

With  this  data  the  users  have  available  to  them  information 
which  allows  for  effective  decision  making. 

Recommendati ons 

This  research  effort  surfaced  some  issues  related  to 
the  subject  that  need  further  research.  This  study  concluded 
that  the  two  new  data  systems  do  provide  improved  R&M  data. 
However,  it  did  not  consider  the  cost  effectiveness  of  the 
improved  capability.  An  area  of  further  research  would  be 


to  perform  a  cost  analysis  study  to  determine  the  financial 
implications  of  the  additional  data  systems. 

In  gathering  the  data  for  this  study,  it  was  learned 
that  AFLC  will  be  supplementing  their  present  MDC  system  with 
a  new  data  system  called  Maintenance  and  Operational  Data 
Access  System  (MODAS).  It  will  be  very  similar  to  the  F - 1 6 
SPO  system  since  MARCON  will  be  the  contractor.  It  is  pro¬ 
jected  to  be  operational  in  the  early  part  of  1984.  After 
this  system  becomes  fully  functional,  it  might  provide 
possible  areas  in  which  further  R&M  information  research 
could  be  performed. 

And  finally,  an  area  where  research  is  required  is  in 
the  collection  and  reporting  of  maintenance  and  operational 
events.  No  matter  how  much  one  improves  the  computer  systems 
which  store,  process  and  analyze  data,  if  erroneous  data  is 
put  into  the  computer  originally,  the  final  output  can  only 
be  comparable.  So  it  is  imperative  that  the  data  collected 
and  reported  is  error  free.  While  researching  this  thesis, 
the  fact  of  input  errors  always  came  up  in  the  discussions. 
With  the  current  trend  to  improve  the  output  side  of  the 
maintenance  and  operations  data  base  systems,  maybe  some 
organization  will  also  attempt  to  improve  the  input  side. 

Only  then  will  the  Logistic  System  be  able  to  properly 
monitor  and  evaluate  weapon  system  reliability  and  main- 
tai nabi 1 i ty . 
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